2025-10-09 16:25:07,684 [ 202982 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2025-10-09 16:25:07,685 [ 202982 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2025-10-09 16:25:07,685 [ 202982 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2025-10-09 16:25:07,685 [ 202982 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_e6v2m8 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=1e0b53d756cf -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test.py::test_backward_compatability1 test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability test_check_table/test.py::test_check_all_tables 'test_check_table/test.py::test_check_normal_table_corruption[]' 'test_check_table/test.py::test_check_replicated_table_corruption[-_0-.bin]' 'test_check_table/test.py::test_check_replicated_table_simple[-_0]' test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_replica_name test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_zk_path test_cluster_all_replicas/test.py::test_cluster 'test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes]' 'test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes]' test_cluster_all_replicas/test.py::test_global_in 'test_cluster_all_replicas/test.py::test_skip_unavailable_replica[one_shard_three_nodes]' 'test_cluster_all_replicas/test.py::test_skip_unavailable_replica[two_shards_three_nodes]' test_cluster_discovery/test.py::test_cluster_discovery_startup_and_stop test_compression_nested_columns/test.py::test_nested_compression_codec test_concurrent_queries_for_user_restriction/test.py::test_exception_message test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_reloader_interval/test.py::test_reload_config test_config_xml_full/test.py::test_xml_full_conf test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_create_user_and_login/test.py::test_grant_create_user test_create_user_and_login/test.py::test_login test_create_user_and_login/test.py::test_login_as_dropped_user test_create_user_and_login/test.py::test_login_as_dropped_user_xml test_custom_settings/test.py::test_custom_settings test_custom_settings/test.py::test_illformed_setting test_ddl_config_hostname/test.py::test_ddl_queue_delete_add_replica 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[hashed]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[DateTime_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Date_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Float32_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Float64_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Int16_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Int32_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Int64_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Int8_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[String_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[UInt16_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[UInt32_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[UInt64_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[UInt8_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[UUID_]' 'test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_integers_key_hashed]' 'test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_mixed_key_hashed]' 'test_dictionaries_select_all/test.py::test_select_all[clickhouse_flat]' 'test_dictionaries_select_all/test.py::test_select_all[clickhouse_hashed]' 'test_dictionaries_select_all/test.py::test_select_all[clickhouse_range_hashed]' 'test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_cache]' 'test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_integers_key_cache]' 'test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_mixed_key_cache]' test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load test_disable_insertion_and_mutation/test.py::test_disable_insertion_and_mutation test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert_with_replica 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_ddl_parallel/test.py::test_all_in_parallel test_distributed_ddl_parallel/test.py::test_slow_dict_load_7 test_distributed_ddl_parallel/test.py::test_smoke test_distributed_ddl_parallel/test.py::test_smoke_parallel test_distributed_ddl_parallel/test.py::test_smoke_parallel_dict_reload test_distributed_ddl_parallel/test.py::test_two_in_parallel_two_queued 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node2]' -vvv" altinityinfra/integration-tests-runner:37a9815fd2fa '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: order-1.0.1, random-0.2, timeout-2.2.0, repeat-0.9.3, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_dictionaries_redis/test.py::test_redis_dictionaries[DateTime_] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] test_distributed_ddl_parallel/test.py::test_all_in_parallel test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_integers_key_hashed] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node1] test_check_table/test.py::test_check_all_tables test_config_decryption/test_wrong_settings.py::test_invalid_chars test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_cache] test_cluster_all_replicas/test.py::test_cluster test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool [gw1] [ 1%] PASSED test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_integers_key_hashed] test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_mixed_key_hashed] [gw9] [ 2%] PASSED test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key [gw1] [ 3%] PASSED test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_mixed_key_hashed] test_dictionaries_select_all/test.py::test_select_all[clickhouse_flat] [gw7] [ 4%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node1] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node2] [gw7] [ 5%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node2] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node1] [gw4] [ 6%] PASSED test_cluster_all_replicas/test.py::test_cluster [gw1] [ 7%] PASSED test_dictionaries_select_all/test.py::test_select_all[clickhouse_flat] test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] test_dictionaries_select_all/test.py::test_select_all[clickhouse_hashed] [gw7] [ 8%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node1] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node2] [gw4] [ 9%] PASSED test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] [gw4] [ 10%] PASSED test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] test_cluster_all_replicas/test.py::test_global_in [gw7] [ 11%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node2] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node1] [gw1] [ 12%] PASSED test_dictionaries_select_all/test.py::test_select_all[clickhouse_hashed] test_dictionaries_select_all/test.py::test_select_all[clickhouse_range_hashed] [gw7] [ 13%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node1] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node2] [gw7] [ 14%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node2] test_create_user_and_login/test.py::test_grant_create_user [gw4] [ 15%] PASSED test_cluster_all_replicas/test.py::test_global_in test_cluster_all_replicas/test.py::test_skip_unavailable_replica[one_shard_three_nodes] [gw1] [ 16%] PASSED test_dictionaries_select_all/test.py::test_select_all[clickhouse_range_hashed] test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_cache] [gw4] [ 17%] PASSED test_cluster_all_replicas/test.py::test_skip_unavailable_replica[one_shard_three_nodes] test_cluster_all_replicas/test.py::test_skip_unavailable_replica[two_shards_three_nodes] [gw4] [ 18%] PASSED test_cluster_all_replicas/test.py::test_skip_unavailable_replica[two_shards_three_nodes] [gw1] [ 19%] PASSED test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_cache] test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_integers_key_cache] [gw1] [ 20%] PASSED test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_integers_key_cache] test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_mixed_key_cache] test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup [gw9] [ 21%] PASSED test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes [gw7] [ 22%] PASSED test_create_user_and_login/test.py::test_grant_create_user test_create_user_and_login/test.py::test_login [gw1] [ 23%] PASSED test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_mixed_key_cache] [gw7] [ 24%] PASSED test_create_user_and_login/test.py::test_login test_create_user_and_login/test.py::test_login_as_dropped_user [gw7] [ 25%] PASSED test_create_user_and_login/test.py::test_login_as_dropped_user test_create_user_and_login/test.py::test_login_as_dropped_user_xml [gw6] [ 26%] PASSED test_check_table/test.py::test_check_all_tables test_check_table/test.py::test_check_normal_table_corruption[] test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_replica_name [gw7] [ 27%] PASSED test_create_user_and_login/test.py::test_login_as_dropped_user_xml [gw5] [ 28%] PASSED test_distributed_ddl_parallel/test.py::test_all_in_parallel test_distributed_ddl_parallel/test.py::test_slow_dict_load_7 [gw9] [ 29%] PASSED test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert [gw6] [ 30%] PASSED test_check_table/test.py::test_check_normal_table_corruption[] test_check_table/test.py::test_check_replicated_table_corruption[-_0-.bin] [gw1] [ 31%] PASSED test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_replica_name test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_zk_path [gw5] [ 32%] PASSED test_distributed_ddl_parallel/test.py::test_slow_dict_load_7 test_distributed_ddl_parallel/test.py::test_smoke [gw0] [ 33%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[DateTime_] test_dictionaries_redis/test.py::test_redis_dictionaries[Date_] [gw9] [ 34%] PASSED test_config_decryption/test_wrong_settings.py::test_wrong_method test_custom_settings/test.py::test_custom_settings [gw1] [ 35%] PASSED test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_zk_path [gw8] [ 36%] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated [gw7] [ 37%] PASSED test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert_with_replica [gw9] [ 38%] PASSED test_custom_settings/test.py::test_custom_settings test_custom_settings/test.py::test_illformed_setting [gw9] [ 39%] PASSED test_custom_settings/test.py::test_illformed_setting [gw3] [ 40%] PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_cache] test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_direct] test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] [gw2] [ 41%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] [gw7] [ 42%] PASSED test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert_with_replica test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic [gw0] [ 43%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Date_] test_dictionaries_redis/test.py::test_redis_dictionaries[Float32_] [gw5] [ 44%] FAILED test_distributed_ddl_parallel/test.py::test_smoke test_distributed_ddl_parallel/test.py::test_smoke_parallel test_backward_compatibility/test.py::test_backward_compatability1 [gw5] [ 45%] PASSED test_distributed_ddl_parallel/test.py::test_smoke_parallel test_distributed_ddl_parallel/test.py::test_smoke_parallel_dict_reload [gw4] [ 46%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table [gw5] [ 47%] PASSED test_distributed_ddl_parallel/test.py::test_smoke_parallel_dict_reload test_distributed_ddl_parallel/test.py::test_two_in_parallel_two_queued [gw4] [ 48%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table [gw7] [ 49%] PASSED test_backward_compatibility/test.py::test_backward_compatability1 [gw1] [ 50%] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] [gw0] [ 51%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Float32_] test_dictionaries_redis/test.py::test_redis_dictionaries[Float64_] [gw5] [ 52%] PASSED test_distributed_ddl_parallel/test.py::test_two_in_parallel_two_queued test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability test_create_query_constraints/test.py::test_create_query_const_constraints [gw3] [ 53%] PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_direct] test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_hashed] test_concurrent_queries_for_user_restriction/test.py::test_exception_message [gw2] [ 54%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] [gw0] [ 55%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Float64_] test_dictionaries_redis/test.py::test_redis_dictionaries[Int16_] [gw4] [ 56%] PASSED test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints [gw5] [ 57%] PASSED test_concurrent_queries_for_user_restriction/test.py::test_exception_message [gw7] [ 58%] PASSED test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability [gw4] [ 59%] PASSED test_create_query_constraints/test.py::test_create_query_minmax_constraints test_config_corresponding_root/test.py::test_work test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf test_compression_nested_columns/test.py::test_nested_compression_codec [gw0] [ 60%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Int16_] test_dictionaries_redis/test.py::test_redis_dictionaries[Int32_] [gw5] [ 61%] PASSED test_config_corresponding_root/test.py::test_work test_ddl_config_hostname/test.py::test_ddl_queue_delete_add_replica [gw3] [ 62%] PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_hashed] test_dictionaries_all_layouts_separate_sources/test_http.py::test_ranged[range_hashed] [gw1] [ 63%] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] [gw2] [ 64%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] [gw4] [ 65%] PASSED test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load [gw7] [ 66%] PASSED test_compression_nested_columns/test.py::test_nested_compression_codec [gw8] [ 67%] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_config_xml_full/test.py::test_xml_full_conf test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability [gw0] [ 68%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Int32_] test_dictionaries_redis/test.py::test_redis_dictionaries[Int64_] [gw3] [ 69%] PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_ranged[range_hashed] test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[cache] [gw2] [ 70%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] [gw5] [ 71%] PASSED test_ddl_config_hostname/test.py::test_ddl_queue_delete_add_replica [gw4] [ 72%] PASSED test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load test_disable_insertion_and_mutation/test.py::test_disable_insertion_and_mutation [gw1] [ 73%] PASSED test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability test_config_reloader_interval/test.py::test_reload_config [gw7] [ 74%] PASSED test_config_xml_full/test.py::test_xml_full_conf [gw0] [ 75%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Int64_] test_dictionaries_redis/test.py::test_redis_dictionaries[Int8_] [gw1] [ 76%] PASSED test_config_reloader_interval/test.py::test_reload_config [gw3] [ 77%] PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[cache] test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[direct] [gw0] [ 78%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Int8_] test_dictionaries_redis/test.py::test_redis_dictionaries[String_] [gw9] [ 79%] PASSED test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic [gw2] [ 80%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column [gw5] [ 81%] PASSED test_disable_insertion_and_mutation/test.py::test_disable_insertion_and_mutation [gw0] [ 82%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[String_] test_dictionaries_redis/test.py::test_redis_dictionaries[UInt16_] [gw9] [ 83%] PASSED test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column test_cluster_discovery/test.py::test_cluster_discovery_startup_and_stop [gw3] [ 84%] PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[direct] test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[flat] [gw0] [ 85%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[UInt16_] test_dictionaries_redis/test.py::test_redis_dictionaries[UInt32_] [gw2] [ 86%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] [gw8] [ 87%] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool [gw8] [ 88%] PASSED test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool [gw0] [ 89%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[UInt32_] test_dictionaries_redis/test.py::test_redis_dictionaries[UInt64_] [gw3] [ 90%] PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[flat] test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[hashed] [gw0] [ 91%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[UInt64_] test_dictionaries_redis/test.py::test_redis_dictionaries[UInt8_] [gw2] [ 92%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] [gw6] [ 93%] PASSED test_check_table/test.py::test_check_replicated_table_corruption[-_0-.bin] test_check_table/test.py::test_check_replicated_table_simple[-_0] [gw6] [ 94%] PASSED test_check_table/test.py::test_check_replicated_table_simple[-_0] [gw0] [ 95%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[UInt8_] test_dictionaries_redis/test.py::test_redis_dictionaries[UUID_] test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge [gw9] [ 96%] PASSED test_cluster_discovery/test.py::test_cluster_discovery_startup_and_stop [gw3] [ 97%] PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[hashed] [gw0] [ 98%] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[UUID_] [gw2] [ 99%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] [gw6] [100%] PASSED test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge =================================== FAILURES =================================== __________________________________ test_smoke __________________________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 def test_smoke(): for _ in range(100): > execute_smoke_query() test_distributed_ddl_parallel/test.py:165: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_distributed_ddl_parallel/test.py:105: in execute_smoke_query initiator.query( helpers/cluster.py:3603: in query return self.client.query( helpers/client.py:36: in wrap return func(self, *args, **kwargs) helpers/client.py:74: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 231, stderr: Received exception from server (version 24.8.14): E Code: 999. DB::Exception: Received from 172.16.10.7:9000. Coordination::Exception. Coordination::Exception: Coordination error: Operation timeout, path /clickhouse/task_queue/ddl/query-. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000003435ea14 E 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001adb2269 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000aa90445 E 3. ./src/Common/LoggingFormatStringHelpers.h:45: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000026488b99 E 4. ./src/Common/ZooKeeper/IKeeper.h:501: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000026486f83 E 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::createAncestors(String const&) @ 0x000000002e5f85fd E 6. ./build_docker/./src/Interpreters/DDLWorker.cpp:0: DB::DDLWorker::enqueueQuery(DB::DDLLogEntry&) @ 0x000000002869fc21 E 7. ./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:593: DB::executeDDLQueryOnCluster(std::shared_ptr const&, std::shared_ptr, DB::DDLQueryOnClusterParams const&) @ 0x0000000029b0ab9b E 8. ./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterDropQuery::executeSingleDropQuery(std::shared_ptr const&) @ 0x00000000291f3baf E 9. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:68: DB::InterpreterDropQuery::execute() @ 0x00000000291f31cd E 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x0000000029b3fcdc E 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1397: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000029b39065 E 12. ./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:612: DB::TCPHandler::runImpl() @ 0x000000002d18174c E 13. ./build_docker/./src/Server/TCPHandler.cpp:2517: DB::TCPHandler::run() @ 0x000000002d1b5580 E 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003453c1af E 15. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003453cd97 E 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:219: Poco::PooledThread::run() @ 0x000000003443f4ab E 17. ./base/poco/Foundation/include/Poco/SharedPtr.h:231: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000034439608 E 18. asan_thread_start(void*) @ 0x000000000aa45059 E 19. ? @ 0x00007fe1e20faac3 E 20. ? @ 0x00007fe1e218c850 E . (KEEPER_EXCEPTION) E (query: DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b) helpers/client.py:239: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-10-09 16:26:02 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:02 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:03 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:04 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:04 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:04 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:05 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:05 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:06 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:06 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:06 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:07 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:07 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:07 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:08 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:08 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:09 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:09 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:09 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:10 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:10 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:10 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:11 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:11 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:12 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:12 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:12 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:13 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:13 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:14 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:15 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:16 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:16 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:16 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:17 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:17 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:18 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:18 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:18 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:19 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:19 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:19 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:20 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:20 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:20 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:21 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:22 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:23 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:23 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:24 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:25 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:26 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:26 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:27 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:27 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:28 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:28 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:29 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:29 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:30 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:31 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:31 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:35 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:37 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:38 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) 2025-10-09 16:26:38 [ 569 ] DEBUG : Executing query DROP DATABASE IF EXISTS foo ON CLUSTER cluster_b on initiator (cluster.py:3602, query) ============================== slowest durations =============================== 316.87s call test_check_table/test.py::test_check_replicated_table_corruption[-_0-.bin] 162.90s call test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated 135.45s call test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic 100.05s call test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_direct] 99.26s call test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas 98.65s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 64.95s setup test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic 55.73s setup test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 54.76s call test_dictionaries_redis/test.py::test_redis_dictionaries[Float32_] 52.40s setup test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 52.15s call test_cluster_discovery/test.py::test_cluster_discovery_startup_and_stop 47.96s setup test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 46.93s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 45.52s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 44.65s call test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_cache] 44.36s call test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[direct] 44.16s call test_distributed_ddl_parallel/test.py::test_smoke 43.91s setup test_backward_compatibility/test.py::test_backward_compatability1 43.37s call test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_hashed] 43.19s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 43.14s call test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[cache] 42.61s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 41.31s call test_dictionaries_redis/test.py::test_redis_dictionaries[Date_] 38.39s call test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[flat] 37.76s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 36.16s call test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool 35.45s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 35.41s call test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[hashed] 35.25s call test_distributed_ddl_parallel/test.py::test_smoke_parallel_dict_reload 33.37s setup test_disable_insertion_and_mutation/test.py::test_disable_insertion_and_mutation 32.22s setup test_distributed_ddl_parallel/test.py::test_all_in_parallel 30.74s setup test_cluster_discovery/test.py::test_cluster_discovery_startup_and_stop 29.04s setup test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge 28.47s call test_dictionaries_redis/test.py::test_redis_dictionaries[Float64_] 27.81s call test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 27.45s call test_dictionaries_redis/test.py::test_redis_dictionaries[Int32_] 26.98s setup test_dictionaries_redis/test.py::test_redis_dictionaries[DateTime_] 25.24s call test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 25.04s teardown test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert_with_replica 24.65s call test_dictionaries_redis/test.py::test_redis_dictionaries[Int16_] 24.60s teardown test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 24.58s call test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 24.49s call test_config_xml_full/test.py::test_xml_full_conf 24.19s call test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf 24.00s call test_dictionaries_redis/test.py::test_redis_dictionaries[DateTime_] 23.95s teardown test_disable_insertion_and_mutation/test.py::test_disable_insertion_and_mutation 22.69s call test_dictionaries_redis/test.py::test_redis_dictionaries[String_] 22.68s call test_dictionaries_redis/test.py::test_redis_dictionaries[Int64_] 22.39s setup test_ddl_config_hostname/test.py::test_ddl_queue_delete_add_replica 22.38s setup test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool 21.88s call test_dictionaries_redis/test.py::test_redis_dictionaries[Int8_] 21.88s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 21.69s teardown test_backward_compatibility/test.py::test_backward_compatability1 20.91s call test_dictionaries_redis/test.py::test_redis_dictionaries[UInt16_] 20.85s call test_dictionaries_all_layouts_separate_sources/test_http.py::test_ranged[range_hashed] 20.83s call test_dictionaries_redis/test.py::test_redis_dictionaries[UInt32_] 20.53s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 20.40s setup test_check_table/test.py::test_check_all_tables 19.42s setup test_compression_nested_columns/test.py::test_nested_compression_codec 19.39s call test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load 19.18s setup test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_cache] 18.42s call test_dictionaries_redis/test.py::test_redis_dictionaries[UUID_] 18.33s call test_dictionaries_redis/test.py::test_redis_dictionaries[UInt64_] 17.53s call test_dictionaries_redis/test.py::test_redis_dictionaries[UInt8_] 17.03s setup test_config_corresponding_root/test.py::test_work 16.94s teardown test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 16.66s call test_distributed_ddl_parallel/test.py::test_two_in_parallel_two_queued 16.54s call test_config_decryption/test_wrong_settings.py::test_subnodes 16.29s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node1] 16.19s call test_config_decryption/test_wrong_settings.py::test_invalid_chars 16.14s setup test_cluster_all_replicas/test.py::test_cluster 15.19s setup test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability 15.11s setup test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_integers_key_hashed] 14.15s setup test_create_query_constraints/test.py::test_create_query_const_constraints 14.13s setup test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column 13.64s call test_check_table/test.py::test_check_normal_table_corruption[] 13.56s setup test_concurrent_queries_for_user_restriction/test.py::test_exception_message 13.51s teardown test_distributed_ddl_parallel/test.py::test_two_in_parallel_two_queued 13.14s setup test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability 12.81s setup test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_replica_name 12.24s call test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 12.22s call test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool 12.22s teardown test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 11.89s teardown test_config_xml_full/test.py::test_xml_full_conf 10.67s call test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert_with_replica 10.25s teardown test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool 10.20s call test_config_decryption/test_wrong_settings.py::test_no_encryption_key 9.91s teardown test_compression_nested_columns/test.py::test_nested_compression_codec 9.90s call test_check_table/test.py::test_check_all_tables 9.61s call test_config_decryption/test_wrong_settings.py::test_wrong_method 9.38s teardown test_custom_settings/test.py::test_illformed_setting 9.34s teardown test_check_table/test.py::test_check_replicated_table_simple[-_0] 8.93s setup test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert 8.75s teardown test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_zk_path 8.61s call test_distributed_ddl_parallel/test.py::test_all_in_parallel 8.59s setup test_custom_settings/test.py::test_custom_settings 8.47s teardown test_ddl_config_hostname/test.py::test_ddl_queue_delete_add_replica 8.26s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 7.86s call test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_zk_path 7.81s setup test_config_reloader_interval/test.py::test_reload_config 7.77s call test_create_user_and_login/test.py::test_login_as_dropped_user_xml 7.56s call test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert 7.43s call test_distributed_ddl_parallel/test.py::test_smoke_parallel 7.31s teardown test_concurrent_queries_for_user_restriction/test.py::test_exception_message 7.29s teardown test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability 7.24s call test_distributed_ddl_parallel/test.py::test_slow_dict_load_7 6.98s setup test_create_user_and_login/test.py::test_grant_create_user 6.84s setup test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load 6.78s teardown test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load 6.49s teardown test_cluster_all_replicas/test.py::test_skip_unavailable_replica[two_shards_three_nodes] 6.35s teardown test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_mixed_key_cache] 6.28s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[UUID_] 6.22s teardown test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[hashed] 6.02s teardown test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column 5.80s teardown test_create_query_constraints/test.py::test_create_query_minmax_constraints 5.77s teardown test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic 5.75s call test_check_table/test.py::test_check_replicated_table_simple[-_0] 5.63s teardown test_config_reloader_interval/test.py::test_reload_config 5.57s teardown test_create_user_and_login/test.py::test_login_as_dropped_user_xml 5.13s call test_disable_insertion_and_mutation/test.py::test_disable_insertion_and_mutation 4.94s call test_compression_nested_columns/test.py::test_nested_compression_codec 4.83s call test_ddl_config_hostname/test.py::test_ddl_queue_delete_add_replica 4.81s teardown test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge 4.75s call test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability 4.72s teardown test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability 4.57s teardown test_cluster_discovery/test.py::test_cluster_discovery_startup_and_stop 3.50s call test_create_query_constraints/test.py::test_create_query_minmax_constraints 3.45s call test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability 3.40s call test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_integers_key_cache] 2.93s call test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_mixed_key_cache] 2.65s call test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_cache] 2.59s call test_create_query_constraints/test.py::test_create_query_const_constraints 2.03s call test_custom_settings/test.py::test_custom_settings 2.00s call test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column 1.89s call test_create_user_and_login/test.py::test_login_as_dropped_user 1.70s call test_concurrent_queries_for_user_restriction/test.py::test_exception_message 1.64s call test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge 1.45s call test_backward_compatibility/test.py::test_backward_compatability1 1.26s call test_config_reloader_interval/test.py::test_reload_config 1.23s call test_create_user_and_login/test.py::test_grant_create_user 1.02s call test_cluster_all_replicas/test.py::test_cluster 0.98s call test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_replica_name 0.96s call test_create_user_and_login/test.py::test_login 0.76s call test_cluster_all_replicas/test.py::test_global_in 0.75s call test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_integers_key_hashed] 0.70s call test_dictionaries_select_all/test.py::test_select_all[clickhouse_range_hashed] 0.65s call test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_mixed_key_hashed] 0.65s call test_dictionaries_select_all/test.py::test_select_all[clickhouse_hashed] 0.65s call test_dictionaries_select_all/test.py::test_select_all[clickhouse_flat] 0.46s call test_custom_settings/test.py::test_illformed_setting 0.42s teardown test_create_user_and_login/test.py::test_login_as_dropped_user 0.42s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node1] 0.42s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node2] 0.37s call test_cluster_all_replicas/test.py::test_skip_unavailable_replica[two_shards_three_nodes] 0.32s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node2] 0.27s teardown test_create_user_and_login/test.py::test_grant_create_user 0.27s call test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] 0.27s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node1] 0.27s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node2] 0.27s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node1] 0.27s call test_cluster_all_replicas/test.py::test_skip_unavailable_replica[one_shard_three_nodes] 0.23s teardown test_create_user_and_login/test.py::test_login 0.22s call test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] 0.07s setup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 0.05s setup test_config_decryption/test_wrong_settings.py::test_invalid_chars 0.02s teardown test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 0.01s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 0.01s teardown test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool 0.01s teardown test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_cache] 0.01s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[Date_] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 0.00s teardown test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[Float32_] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 0.00s setup test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_direct] 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[DateTime_] 0.00s setup test_config_xml_full/test.py::test_xml_full_conf 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_hashed] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[Float32_] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_hashed] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[Float64_] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_direct] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 0.00s teardown test_check_table/test.py::test_check_replicated_table_corruption[-_0-.bin] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_http.py::test_ranged[range_hashed] 0.00s teardown test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_integers_key_cache] 0.00s setup test_check_table/test.py::test_check_replicated_table_simple[-_0] 0.00s setup test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas 0.00s teardown test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf 0.00s setup test_distributed_ddl_parallel/test.py::test_two_in_parallel_two_queued 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 0.00s teardown test_distributed_ddl_parallel/test.py::test_smoke_parallel 0.00s teardown test_distributed_ddl_parallel/test.py::test_smoke_parallel_dict_reload 0.00s setup test_distributed_ddl_parallel/test.py::test_smoke 0.00s setup test_distributed_ddl_parallel/test.py::test_smoke_parallel_dict_reload 0.00s teardown test_distributed_ddl_parallel/test.py::test_smoke 0.00s teardown test_distributed_ddl_parallel/test.py::test_all_in_parallel 0.00s setup test_distributed_ddl_parallel/test.py::test_slow_dict_load_7 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_http.py::test_ranged[range_hashed] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[cache] 0.00s teardown test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_replica_name 0.00s teardown test_check_table/test.py::test_check_normal_table_corruption[] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[Date_] 0.00s setup test_distributed_ddl_parallel/test.py::test_smoke_parallel 0.00s setup test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert_with_replica 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node1] 0.00s setup test_custom_settings/test.py::test_illformed_setting 0.00s teardown test_check_table/test.py::test_check_all_tables 0.00s setup test_create_user_and_login/test.py::test_login_as_dropped_user 0.00s setup test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf 0.00s teardown test_custom_settings/test.py::test_custom_settings 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[UInt16_] 0.00s setup test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[UInt8_] 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node2] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[UInt64_] 0.00s setup test_cluster_all_replicas/test.py::test_skip_unavailable_replica[one_shard_three_nodes] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[hashed] 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node1] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[Int32_] 0.00s teardown test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas 0.00s setup test_dictionaries_select_all/test.py::test_select_all[clickhouse_range_hashed] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[flat] 0.00s setup test_check_table/test.py::test_check_normal_table_corruption[] 0.00s setup test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[Int8_] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[direct] 0.00s setup test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_integers_key_cache] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[Int16_] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 0.00s setup test_dictionaries_select_all/test.py::test_select_all[clickhouse_hashed] 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node2] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[Int64_] 0.00s teardown test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[String_] 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[Int64_] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[String_] 0.00s setup test_check_table/test.py::test_check_replicated_table_corruption[-_0-.bin] 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[Int16_] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[cache] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[UUID_] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[direct] 0.00s setup test_create_user_and_login/test.py::test_login_as_dropped_user_xml 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[Int32_] 0.00s teardown test_config_corresponding_root/test.py::test_work 0.00s setup test_config_decryption/test_wrong_settings.py::test_wrong_method 0.00s teardown test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_integers_key_hashed] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 0.00s setup test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_mixed_key_hashed] 0.00s setup test_dictionaries_redis/test.py::test_redis_dictionaries[UInt32_] 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[UInt64_] 0.00s teardown test_config_decryption/test_wrong_settings.py::test_wrong_method 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[UInt32_] 0.00s setup test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_cache] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node2] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 0.00s setup test_create_user_and_login/test.py::test_login 0.00s setup test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_mixed_key_cache] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[flat] 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node1] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 0.00s setup test_dictionaries_select_all/test.py::test_select_all[clickhouse_flat] 0.00s call test_config_corresponding_root/test.py::test_work 0.00s setup test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[UInt16_] 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node1] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node2] 0.00s teardown test_config_decryption/test_wrong_settings.py::test_subnodes 0.00s teardown test_create_query_constraints/test.py::test_create_query_const_constraints 0.00s setup test_create_query_constraints/test.py::test_create_query_minmax_constraints 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node2] 0.00s setup test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_zk_path 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[Float64_] 0.00s setup test_cluster_all_replicas/test.py::test_skip_unavailable_replica[two_shards_three_nodes] 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[UInt8_] 0.00s teardown test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] 0.00s teardown test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_cache] 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node1] 0.00s teardown test_config_decryption/test_wrong_settings.py::test_invalid_chars 0.00s setup test_config_decryption/test_wrong_settings.py::test_subnodes 0.00s teardown test_config_decryption/test_wrong_settings.py::test_no_encryption_key 0.00s teardown test_dictionaries_redis/test.py::test_redis_dictionaries[Int8_] 0.00s teardown test_cluster_all_replicas/test.py::test_cluster 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node2] 0.00s teardown test_cluster_all_replicas/test.py::test_skip_unavailable_replica[one_shard_three_nodes] 0.00s setup test_cluster_all_replicas/test.py::test_global_in 0.00s teardown test_distributed_ddl_parallel/test.py::test_slow_dict_load_7 0.00s teardown test_dictionaries_select_all/test.py::test_select_all[clickhouse_flat] 0.00s setup test_config_decryption/test_wrong_settings.py::test_no_encryption_key 0.00s teardown test_dictionaries_select_all/test.py::test_select_all[clickhouse_hashed] 0.00s teardown test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] 0.00s teardown test_dictionaries_select_all/test.py::test_select_all[clickhouse_range_hashed] 0.00s teardown test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_mixed_key_hashed] 0.00s teardown test_cluster_all_replicas/test.py::test_global_in =========================== short test summary info ============================ FAILED test_distributed_ddl_parallel/test.py::test_smoke - helpers.client.Que... PASSED test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_integers_key_hashed] PASSED test_config_decryption/test_wrong_settings.py::test_invalid_chars PASSED test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_mixed_key_hashed] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node1] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node2] PASSED test_cluster_all_replicas/test.py::test_cluster PASSED test_dictionaries_select_all/test.py::test_select_all[clickhouse_flat] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node1] PASSED test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes] PASSED test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node2] PASSED test_dictionaries_select_all/test.py::test_select_all[clickhouse_hashed] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node1] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node2] PASSED test_cluster_all_replicas/test.py::test_global_in PASSED test_dictionaries_select_all/test.py::test_select_all[clickhouse_range_hashed] PASSED test_cluster_all_replicas/test.py::test_skip_unavailable_replica[one_shard_three_nodes] PASSED test_cluster_all_replicas/test.py::test_skip_unavailable_replica[two_shards_three_nodes] PASSED test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_cache] PASSED test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_integers_key_cache] PASSED test_config_decryption/test_wrong_settings.py::test_no_encryption_key PASSED test_create_user_and_login/test.py::test_grant_create_user PASSED test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_mixed_key_cache] PASSED test_create_user_and_login/test.py::test_login PASSED test_create_user_and_login/test.py::test_login_as_dropped_user PASSED test_check_table/test.py::test_check_all_tables PASSED test_create_user_and_login/test.py::test_login_as_dropped_user_xml PASSED test_distributed_ddl_parallel/test.py::test_all_in_parallel PASSED test_config_decryption/test_wrong_settings.py::test_subnodes PASSED test_check_table/test.py::test_check_normal_table_corruption[] PASSED test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_replica_name PASSED test_distributed_ddl_parallel/test.py::test_slow_dict_load_7 PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[DateTime_] PASSED test_config_decryption/test_wrong_settings.py::test_wrong_method PASSED test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_zk_path PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool PASSED test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert PASSED test_custom_settings/test.py::test_custom_settings PASSED test_custom_settings/test.py::test_illformed_setting PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_cache] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] PASSED test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert_with_replica PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Date_] PASSED test_distributed_ddl_parallel/test.py::test_smoke_parallel PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup PASSED test_distributed_ddl_parallel/test.py::test_smoke_parallel_dict_reload PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table PASSED test_backward_compatibility/test.py::test_backward_compatability1 PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Float32_] PASSED test_distributed_ddl_parallel/test.py::test_two_in_parallel_two_queued PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_direct] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Float64_] PASSED test_create_query_constraints/test.py::test_create_query_const_constraints PASSED test_concurrent_queries_for_user_restriction/test.py::test_exception_message PASSED test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability PASSED test_create_query_constraints/test.py::test_create_query_minmax_constraints PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Int16_] PASSED test_config_corresponding_root/test.py::test_work PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_hashed] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] PASSED test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf PASSED test_compression_nested_columns/test.py::test_nested_compression_codec PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Int32_] PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_ranged[range_hashed] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] PASSED test_ddl_config_hostname/test.py::test_ddl_queue_delete_add_replica PASSED test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load PASSED test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability PASSED test_config_xml_full/test.py::test_xml_full_conf PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Int64_] PASSED test_config_reloader_interval/test.py::test_reload_config PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[cache] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[Int8_] PASSED test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] PASSED test_disable_insertion_and_mutation/test.py::test_disable_insertion_and_mutation PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[String_] PASSED test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[direct] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[UInt16_] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas PASSED test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[UInt32_] PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[flat] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[UInt64_] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] PASSED test_check_table/test.py::test_check_replicated_table_corruption[-_0-.bin] PASSED test_check_table/test.py::test_check_replicated_table_simple[-_0] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[UInt8_] PASSED test_cluster_discovery/test.py::test_cluster_discovery_startup_and_stop PASSED test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[hashed] PASSED test_dictionaries_redis/test.py::test_redis_dictionaries[UUID_] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] PASSED test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge =================== 1 failed, 99 passed in 416.55s (0:06:56) =================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_e6v2m8 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=1e0b53d756cf -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test.py::test_backward_compatability1 test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability test_check_table/test.py::test_check_all_tables 'test_check_table/test.py::test_check_normal_table_corruption[]' 'test_check_table/test.py::test_check_replicated_table_corruption[-_0-.bin]' 'test_check_table/test.py::test_check_replicated_table_simple[-_0]' test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_replica_name test_cleanup_dir_after_bad_zk_conn/test.py::test_cleanup_dir_after_wrong_zk_path test_cluster_all_replicas/test.py::test_cluster 'test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[one_shard_three_nodes]' 'test_cluster_all_replicas/test.py::test_error_on_unavailable_replica[two_shards_three_nodes]' test_cluster_all_replicas/test.py::test_global_in 'test_cluster_all_replicas/test.py::test_skip_unavailable_replica[one_shard_three_nodes]' 'test_cluster_all_replicas/test.py::test_skip_unavailable_replica[two_shards_three_nodes]' test_cluster_discovery/test.py::test_cluster_discovery_startup_and_stop test_compression_nested_columns/test.py::test_nested_compression_codec test_concurrent_queries_for_user_restriction/test.py::test_exception_message test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_reloader_interval/test.py::test_reload_config test_config_xml_full/test.py::test_xml_full_conf test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_create_user_and_login/test.py::test_grant_create_user test_create_user_and_login/test.py::test_login test_create_user_and_login/test.py::test_login_as_dropped_user test_create_user_and_login/test.py::test_login_as_dropped_user_xml test_custom_settings/test.py::test_custom_settings test_custom_settings/test.py::test_illformed_setting test_ddl_config_hostname/test.py::test_ddl_queue_delete_add_replica 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_http.py::test_simple[hashed]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[DateTime_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Date_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Float32_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Float64_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Int16_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Int32_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Int64_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[Int8_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[String_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[UInt16_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[UInt32_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[UInt64_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[UInt8_]' 'test_dictionaries_redis/test.py::test_redis_dictionaries[UUID_]' 'test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_integers_key_hashed]' 'test_dictionaries_select_all/test.py::test_select_all[clickhouse_complex_mixed_key_hashed]' 'test_dictionaries_select_all/test.py::test_select_all[clickhouse_flat]' 'test_dictionaries_select_all/test.py::test_select_all[clickhouse_hashed]' 'test_dictionaries_select_all/test.py::test_select_all[clickhouse_range_hashed]' 'test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_cache]' 'test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_integers_key_cache]' 'test_dictionaries_select_all/test.py::test_select_all_from_cached[clickhouse_complex_mixed_key_cache]' test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load test_disable_insertion_and_mutation/test.py::test_disable_insertion_and_mutation test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert test_distributed_async_insert_for_node_changes/test.py::test_distributed_async_insert_with_replica 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_ddl_parallel/test.py::test_all_in_parallel test_distributed_ddl_parallel/test.py::test_slow_dict_load_7 test_distributed_ddl_parallel/test.py::test_smoke test_distributed_ddl_parallel/test.py::test_smoke_parallel test_distributed_ddl_parallel/test.py::test_smoke_parallel_dict_reload test_distributed_ddl_parallel/test.py::test_two_in_parallel_two_queued 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[cluster_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_sum[dod_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_group_by_key[cluster_node2]' -vvv" altinityinfra/integration-tests-runner:37a9815fd2fa ' returned non-zero exit status 1.